Self-organization in nonadditive systems with external noise 
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A nonadditive generalization of Klimontovich's S-theorem [G. B. Bagci, Int. J. Mod. Phys. B 22, 
3381 (2008)] has recently been obtained by employing Tsallis entropy. This general version allows 
one to study physical systems whose stationary distributions are of the inverse power law in contrast 
to the original S-theorem, which only allows exponential stationary distributions. The nonadditive 
S-theorem has been applied to the modified Van der Pol oscillator with inverse power law stationary 
distribution. By using nonadditive S-theorem, it is shown that the entropy decreases as the system 
is driven out of equilibrium, indicating self-organization in the system. The allowed values of the 
nonadditivity index q are found to be confined to the regime (0.5, 1.0]. 
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I. INTRODUCTION 



Klimontovich [1] originally proposed S-theorem (Self-organization theorem) in order to generalize Gibbs' theorem 
[2] to open systems, since the latter rests on the assumption that all the compared distributions have the same mean 
energy values. However, this assumption does not hold when one studies open systems with energy or matter influx. 
Therefore, Klimontovich considered equating the mean energies of different states before comparing the associated 
entropies. This process of equating mean energies of different states is called renormalization (not to be confused by 
renormalization in quantum field theory) by Klimontovich. However, S-theorem did not only succeed in generalizing 
Gibbs' theorem but gained recognition as a criterion of self-organization in open systems, since it allows us compare 
even the stationary nonequilibrium distributions [3-7]. 

In open systems, we have some control parameters, which determine the stationary distributions of the system. As 
the control parameter increases, the system recedes away from equilibrium, increasing its mean energy and entropy. 
S-theorem orders the associated entropies in such a way that the state closer to equilibrium possesses a greater entropy 
compared to the other states. In other words, we have a more ordered state as the control parameter increases. This 
decrease of entropy on ordering is called self-organization by Haken [8] . 

It is worth noting that the use of S-theorem is not limited to analytical models. It has also been used for many 
numerical models such as logistic map [9], heart rate variability [10, 11] and the analysis of electroencephalograms of 
epilepsy patients [12] as a criterion of self-organization. 

Despite all its past successes, S-theorem rests on the use of Boltzmann-Gibbs (BG) entropy. Therefore, it is devised 
to handle cases with exponential stationary distributions. On the other hand, the study of open systems often results 
in stationary distributions of the inverse power law form. Hence, it is important to generalize S-theorem so that its 
use can be extended to open systems with stationary distributions of inverse power law form. Such a generalization 
has recently been made [13] by the employment of Tsallis entropy [14-16] instead of BG entropy. However, in Ref. 
[13], a rigorous application of the nonadditive S-theorem was not present [17]. We here present an application of the 
generalized S-theorem to the modified Van der Pol oscillator with inverse power law stationary distributions. 

The paper is organized as follows: In Section II, we review the nonadditive S-theorem for open nonadditive systems. 
The application of the nonadditive S-theorem to the modified Van der Pol oscillator is presented in Section III. 
Concluding remarks will be presented in Section IV. 



II. THE NONADDITIVE S-THEOREM 

We begin by supposing that we have two distinct probability distributions, i.e., r eq and p, corresponding to equi- 
librium and nonequilibrium states, respectively. In open systems, the stationary equilibrium distribution is defined 
as the distribution corresponding to the state where the relevant control parameter is set to zero. Similarly, any 
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other stationary state with non-zero control parameter is defined as the nonequilibrium state. As the value of control 
parameter increases, the system recedes away from equilibrium state. The nonadditive S-theorem is equivalent to 
showing that the renormalized entropy defined as 



R q \pWe q ] = S^ q (p)-S e q q (r eq ) (1) 
is negative i.e., R q < 0, since this implies that S q q > S q eq . S q denotes nonadditive Tsallis entropy 



y w P q - 1 

s q ( P ) = ^\ p _! q , (2) 

where pi is the probability of the system in the ith microstate, W is the total number of the configurations of the 
system. The entropic index q is called the nonadditivity parameter. As q — > 1, the nonadditive Tsallis entropy 
becomes 



w 

S q ^i = -^pilnp,, (3) 

i=l 

which is the usual BG entropy. 

We denote the equilibrium distribution and the associated entropy in Eq. (1) by a tilde, since this is not the 
original equilibrium entropy but the one obtained after the effective mean energy equalization i.e., renormalization. 
This equalization is necessary, because the mean energies of equilibrium and nonequilibrium states are different. We 
define effective mean energy U e ff in terms of the equilibrium state as 



U eS = In, ( J- ) , (4) 



(.:</ 



where the g-logarithm function ln g (x) is defined as 



x l-q _ 1 

The definition of effective mean energy in Eq. (4) is central to our generalization and therefore requires some expla- 
nation. The effective mean energy is defined in terms of the equilibrium distribution obtained from the maximization 
of Tsallis entropy subject to ordinary constraints. Therefore, the application of the effective mean energy definition in 
Eq. (4) to the equilibrium distribution r eq = [1 — (q — l)0Si] 1 ^ q ~ v> (apart from normalization) results in U e g — 0Si. 
This explains why it is called effective mean energy since it is proportional to the multiplication of the Lagrange 
multiplier associated with the internal energy constraint and the energy of the ith microstate. We can write the 
equalization of the effective mean energies of two states as 



{U cS ) {req) = (t/ cff ) (ne9) , (6) 

where superscripts (req) and (neq) denote the renormalized equilibrium and ordinary nonequilibrium states, respec- 
tively. From now on, we will drop the subscript (eq) from the equilibrium probability distribution r. Therefore, it 
should be understood that the probability distributions r and r denote the ordinary and renormalized equilibrium 
distributions, respectively. Using normalization and the effective mean energy definition defined in Eq. (4), Eq. (6) 
can be written in a more explicit form as 



q-l- 



.9-1 



Pi, 



(7) 



where r is the renormalized equilibrium distribution obtained after equating the mean energies. 

We then substitute Tsallis entropy given by Eq. (2) into Eq. (1) to obtain an explicit nonadditive renormalized 
entropy expression 
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Rr 



E^-E ; 



(8) 



We can rewrite the above equation as 



Rr. 



(q 



^(e^-e^+^-^e^-^- 1 ^) 

\ i i i i / 



(9) 



We then substitute r, = r^/C into Eq. (7) in order to calculate J2i^l explicitly where C is normalization constant. 
This yields 



E^ = E^ _1 - ( 10 ) 

i i 

The substitution of the relation in Eq. (10) into Eq. (9) finally results 



r 9 \p¥\ = - + E^ - E^" 1 - E^r 1 • (ii) 

\ i i i / 

In order to consider Eq. (11) as the nonadditive S-theorem, we must show that the nonadditivc rcnormalized entropy 
R q (p\\r) is always negative. This can be deduced from the fact that the expression within the parentheses is the 
nonadditive relative entropy i4T g [p||r] [18] i.e., 

i i i 

Since the nonadditive relative entropy i^ 9 [p||r] is positive for all positive q values, we conclude that 



R q \p\\7\ - S q {p) - S q (r) - -K q [p\\7\ < 0. (13) 

It is worth noting that the main reason for excluding negative q values from the above discussion is thermodynamic 
stability of Tsallis entropy, since it is stable only for positive values of q [19]. 

The nonadditive generalization of S-theorem requires the use of ordinary probability distributions i.e., first choice 
of constraints in nonadditive thermostatistics, instead of escort distributions i.e., third choice in nonadditive ther- 
mostatistics. In fact, even the nonadditive relative entropy expression we have used is the one compatible with the 
ordinary probability distribution [13, 18]. 

It should be noted that the ordinary S-theorem by Klimontovich is recovered in the q — > 1 limit. This can be seen 
from the inspection of Eq. (13), since Tsallis entropy expressions become BG entropies, whereas all the stationary 
distributions become exponential in the q — > 1 limit. The nonadditive relative entropy in Eq. (13) becomes Kullback- 
Leiblcr relative entropy in the aforementioned limit i.e., r] = J2iPi ^ n (Pi/ r i) [20], which is positive definite, 
ensuring the negativity of the ordinary renormalized entropy. 



III. NOISE-DRIVEN MODIFIED VAN DER POL OSCILLATOR 



In this section, we will study the noise-driven modified Van der Pol oscillator, which is classified by the following 
Ito-Langevin type two dimensional stochastic equation [21] 



OH OH 
r —+ a 2 f(H-u)—+a<jg{H-u)tl 1 {t), 



y = 



Oy Ox 
OH OH 

~0x~ + /^/(tf; u )^ + P°9(H; 



(14) 
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These type of equations have been first formulated by Enz [22] in the framework of mixcd-canonical-dissipative dynam- 
ics and later used to study nonlinear dynamical systems with noise [23, 24]. The term H(x,y) denotes Hamiltonian. 
We will particularly consider the Hamiltonian of the form H = \{x 2 + y 2 ), where x and y are fluctuating parameters. 
f(H;u) and g(H;u) are some arbitrary functions, which may depend on H and some nonfluctuating control param- 
eters u = {wi,U2}. Gaussian white noise with intensity a = \/2D is generated through £,'s, where a and (3 are real 
parameters. From now on, we will assume a = 0, f3 = 1, and g(H; u) = 1. Then, the most general stationary solution 
for the modified Van der Pol oscillator in Eq. (14) is given by 



(15) 

where C is normalization constant. 

As we remarked above, the function f(H, m, 112) is quite arbitrary and can be changed to another expression as long 
as the new expression can be written in terms of the energy H and the control parameters. We choose the function 
f(H,U!,u 2 ) as 



/ (iO = Cexp 



J dHf(H,ui,u 2 ) 



f(H,u 1 ,u 2 ) = 7- — r (16) 

l + ^( Ul H + u 2 H 2 ) 

and the control parameters as «i = = 7 — 0/ and u 2 = b/2, where 7 is the linear friction coefficient, and a/ is the 
feedback or control parameter. The term b denotes the nonlinear friction coefficient. The corresponding stationary 
distribution, due to Eq. (15), takes the form 



/o, 9 (£) = Cexp 2 _ 9 ^ J 

where g-exponential is defined by 



exp,(x) = [l + (l-g)a:]^. (18) 

The stationary distribution in Eq. (17) is a g-exponential of the order (2 — g), not g. In order to understand this 
expression, it is important to remember that the nonadditive S-theorem requires the use of ordinary constraint. 
The stationary distribution compatible with the first constraint in nonadditive thermostatistics is given by fo, q (E) cx 
exp( 2 _ g )(— x). Following Klimontovich, we assume b (E) /-y <~ Do/7 2 ^ 1 [4, 13], so that the corresponding equilibrium 
distribution associated with zero value of the control parameter is 



r,(20 = ^exp 2 _,(-^) , (19) 

where jq/D is the normalization constant for q values between and 1. Next, we increase the control parameter to a 
value different from zero and create nonequilibrium state in the system. We set the feedback parameter a/ equal to 
7 so that the term a becomes equal to 0. The distribution function can then be written as 



P q (E) 



2(l-g)& 
D 



mi. 1 



2' 1 -q 



1 + 



(20) 



for < q < 1, where the normalization constant is inserted [25]. The renormalization of energies i.e., Eq. (7) becomes 



P CO rOO 

/ dEEr q (E) = / dEEpg (E) . (21) 
Jo JO 

The integral on the right hand side can be easily solved and it yields 



■5 



/ dEEpg (E) = y/(l-q) 
Jo 



Bli 1 1 



2'1-q 2 

for < q < 1. On the other hand, the integral on the left is calculated as 




(22) 



/■OC 
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D 
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for i < g < 1. Therefore, Eq. (21), explicitly written, becomes 



Bii ' 



D = (2q- lhy/O^q) 



2'1-q 2 




for | < q < 1. Therefore, the nonadditive renormalized entropy is calculated as 



(23) 



(24) 
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for i < q < 1, where the renormalized noise intensity D is given by Eq. (24). The nonadditive renormalized entropy 
expression above is always negative for positive values of the nonadditivity parameter q i.e., i? 9 [p||r] < 0, since it is 
the negative of the nonadditive relative entropy X g [p||r] together with the renormalization of the corresponding mean 
energies. The nonadditive renormalized entropy in Eq. (25) is plotted in Figs. 1 and 2 for some particular values 
of the intensity of the random source D and nonlinear friction coefficient b. However, it is important to understand 
that our results are independent of the random source intensity and nonlinear friction coefficient. The nonadditive 
renormalized entropy attains the value —0.05 in the q — ► 1 limit. This is the exact value one would obtain if one 
would use Klimontovich's additive renormalized entropy as a criterion of self-organization. 



IV. CONCLUSIONS 



Klimontovich's original S-theorem is based on turning the ordinary reference distribution into the corresponding 
escort distribution where the exponent of the escort distribution is fixed through mean energy renormalization [3]. 
However, due to the use of BG entropy, original S-theorem is limited to the additive open systems, and exponential 
stationary distributions. In contrast, the nonadditive S-theorem is obtained only by using ordinary probability 
distributions. When we adopt nonadditive Tsallis entropy, we are required to use ordinary probability instead of 
escort distribution, since the nonadditivity index q plays the role of the escort distribution's exponent [13]. 

Klimontovich applied his original S-theorem to Van dcr Pol oscillator with exponential stationary distributions 
[26]. In this work, the nonadditive S-theorem has been applied to a modified Van der Pol oscillator with stationary 
distributions of inverse power law. It is interesting to note that we have modified Van der Pol model of Klimontovich 
only by changing the dissipative term /(if, U\,v,2)- We have shown that the self-organization takes place as the control 
parameter increases from zero value, where the signature of the self-organization in this framework is the negativity 
of the nonadditive renormalized entropy. The nonadditive renormalized entropy attains the value —0.05 in the q — * 1 
limit. This is exactly the same value one would obtain by using Klimontovich's original S-theorem [4, 13]. 

The most important difference in changing the underlying dynamics so that the stationary distribution is of the q- 
cxponential form is the confinement of the q values to a range between 0.5 and 1. If one uses nonadditive renormalized 
entropy together with the exponential stationary distributions obtained from Klimontovich's Van der Pol model, the 
nonadditivity index q can take any value without limitations [13]. However, the change in the dynamics so as to make 
the stationary distributions of the Van der Pol model of q-exponential form, results in a spectrum of some privileged 
q values. This seems to be a general feature one encounters whenever one studies physical systems depending on 
a control parameter [27, 28]. It is also worth remarking how the probability distribution of the first constraint in 
nonadditive thermostatistics i.e., q-exponential with order (2 — q), emerges in the numerical studies concerning systems 
depending upon control parameters [27, 28]. 
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FIG. 1: The plot of nonadditive renormalized entropy _R 9 [p||r] versus the nonadditivity parameter q for three representative 
values of random source intensity D, where nonlinear friction coefficient is 6=70. 
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